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Abstract 

We study the design and approximation of optimal crowdsourcing contests. Crowdsourcing contests 
can be modeled as all-pay auctions because entrants must exert effort up-front to enter. Unlike all- 
pay auctions where a usual design objective would be to maximize revenue, in crowdsourcing contests, 
the principal only benefits from the submission with the highest quality. We give a theory for optimal 
crowdsourcing contests that mirrors the theory of optimal auction design: the optimal crowdsourcing 
contest is a virtual valuation optimizer (the virtual valuation function depends on the distribution of 
contestant skills and the number of contestants). We also compare crowdsourcing contests with more 
conventional means of procurement. In this comparison, crowdsourcing contests are relatively disad- 
vantaged because the effort of losing contestants is wasted. Nonetheless, we show that crowdsourcing 
contests are 2-approximations to conventional methods for a large family of "regular" distributions, and 
4-approximations, otherwise. 
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1 Introduction 



Crowdsourcing contests have become increasingly important and prevalent with the ubiquity of the Internet. 
For instance, instead of hiring a research team to develop a better collaborative filtering algorithm, Netflix 
issued the "Netflix challenge" offering a million dollars to the team that develops an algorithm that beats 
the Neflix algorithm by 10%. More generally, Taskcn allows users to post tasks with monetary rewards, 
collects submissions by other users, and rewards the best submission; and many Q&A sites allow users to 
post questions and reward the best answer with much-coveted "points". We address two questions in this 
paper, (a) what format of crowdsourcing competition induces the highest-quality winning contribution, and 
(b) how inefficient is crowdsourcing over more conventional means of contracting. 

Crowdsourcing competitions can be modeled as all-pay auctions. In the highest-bid-wins single-item 
all-pay auction, the auctioneer solicits payments (as bids), awards the item to the agent with the highest pay- 
ment, and keeps all the agent payments. These auctions are well understood in settings where each agent has 
an independent private value for obtaining the item. In the connection to crowdsourcing contests, the "item" 
is the monetary reward, the payments are the submissions, and the private value is the rate at which the con- 
testant works. However, unlike all-pay auctions, in crowdsourcing competitions the principal usually only 
values the winning submission and has no value for lesser submissions. Therefore, while the performance 
metric for auctions is usually revenue which is the sum of the agent payments, in crowdsourcing contests 
where payments are submissions, the relevant performance metric is the quality of the best submission, i.e., 
the maximum agent "payment". 

The revenue equivalence principle implies that in equilibrium the revenue of the highest-bid-wins all- 
pay auction is the same as that of first- and second-price auction formats; however, in these latter auction 
formats only the winner makes a payment. Since non-winners make payments in all-pay auctions, the max- 
imum agent payment in all-pay auctions is lower than that of first- and second-price auctions. To connect 
this auction theory back to the setting of procurement, first- and second-price auctions are analogous to con- 
ventional procurement mechanisms, e.g., for government contracts, whereas the all-pay format is analogous 
to crowdsourcing contests. Importantly, the performance metric for first- and second-price procurement 
auctions is their revenue, that is, the winner's payment. While the all-pay auction obtains the same total 
revenue, the principal in crowdsourcing cannot attain this full revenue and therefore suffers a loss relative to 
conventional methods. 

Our first result is to show that in expectation the maximum agent payment in highest-bid-wins all- 
pay auctions is at least half its total revenue. Consequently crowdsourcing contests can extract from the 
best submission at least half of the total contribution from the crowd, which in turn implies that they 
are 2-approximate with respect to conventional procurement via highest-bid-wins auctions. Of course, 
highest-bid-wins auctions are not necessarily revenue optimal. However, for a large class of distribu- 
tions (termed regular), auctions that award the item to the highest bidder that meets a reservation price 
are optimal [Mye81 1. In these settings crowdsourcing contests that require submissions to be of a mini- 
mum quality (e.g., the Netflix challenge required submissions to beat the Netflix algorithm by 10%) are 2- 
approximations. For more general distributional settings reserve pricing gives a 2-approximation to the opti- 
mal auction revenue [CHMS 10 ] and crowdsourcing contests with minimum quality conditions are, therefore, 
4-approximations to conventional procurement. This approximation also implies a "simple versus optimal" 
style result, i.e., that the gains from precisely optimizing a contest based on the distribution versus running 
a simple highest-bid-wins crowdsourcing contest with a minimum quality condition are at most a factor of 
4. 

Our second result derives the optimal static crowdsourcing format that maximizes the quality of the 
best submission. Specifically, suppose we fix the reward for the fc-th best submission to be (where we 
normalize the a^'s to Ylk=i a k = !)• What should the a^'s be? For instance on computer programming 
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crowdsourcing site TopCoder.com, the best submission receives 2/3rds and the second-best submission re- 
ceives l/3rd of the total reward. Is this a better format than awarding the entire amount to the best submission 
in terms of the quality of that submission? We prove that it is not: a\ = 1 and au = for k > 1, or winner- 
takes-all, is the optimal choice over all such static contests. 

Of course in some settings it may be better to adjust the number of rewards and their distribution across 
the participants dynamically as functions of the observed submission qualities. Our third result derives the 
format of crowdsourcing contests that dynamically optimizes the quality of the best submission. We give a 
complete characterization of optimal crowdsourcing contests. In what would be a familiar result to auction 
theorists, optimal crowdsourcing contests are "ironed virtual value optimizers" in that the reward is divided 
evenly among all contestants whose submissions are tied under a weakly monotone transformation (via 
the ironed virtual value function) of the submission quality. Importantly, the number of contestants who 
share the reward is determined dynamically and each contestant's share is the same. Perhaps surprisingly, 
and unlike the case of classical auction theory, the transformation to ironed virtual values depends on the 
number of contestants. 

Optimal crowdsourcing contests require the auctioneer to know the distribution of agents' skills, e.g. in 
order to pick an appropriate minimum submission quality. In our fourth result we consider the loss from not 
knowing the distribution. For the revenue objective, Bulow and Klemperer [BK96] proved that for regular 
distributions recruiting an extra bidder is more profitable to the auctioneer than knowing the distribution. We 
show that this result implies that a simple highest-bid-wins contest approximates the optimal contest within 
a factor approaching 2; this limits the benefit of knowing the skill distribution. 

Related Work. This paper follows the connection made between crowdsourcing contests and all-pay auc- 
tions from DiPalantino and Vojnovic HDV09II and questions from Archak and Sundararajan [AS09] and 
Moldovanu and Sela [MS01, MS06] on optimizing the reward structure to improve the quality of the best 
submissions. HAS09I1 and JMS01 ] compare winner-take-all crowdsourcing contests against ones with a stat- 
ically determined division of the reward among top agents, e.g., as in the TopCoder.com mechanism. The 
objective in [MS01] is the sum of the qualities of submissions (analogous to revenue in our discussion) and 
the Archak-Sundararajan objective is the cumulative effort from the top k agents less the monetary reward. 
Both papers show that when agents' submission qualities are linear in their effort winner-take-all is opti- 
mal over other static divisions. The Moldovanu-Sela result also holds when quality is a convex function 
of effort, but not generally for concave functions. Minor [Minll] studies a generalization of the problem 
of Moldovanu and Sela, and derives the optimal crowdsourcing contest via a Myersonian ironing approach 
(again, to maximize the sum of qualities). 

Moldovanu and Sela [MS06] study both the highest quality submission objective and the revenue (sum of 
all submission qualities) objective with the total reward normalized to 1. They compare the performance of 
two-stage contests against one-stage contests. Among one-stage contests they consider both a single grand 
contest, as well as many sub-contests in parallel, with the winner of each sub-contest receiving a prize. In 
two-stage contests, the winners of the first stage sub-contests compete in a final round. These are all static 
contests in the sense that the division of reward among winners of different sub-contests is predetermined. 
For the sum-of-qualities objective, [MS06] prove that a single grand contest is best among these contest 
formats. For the highest quality objective, if there are sufficiently many competitors then it is optimal to 
split the competitors in two divisions and to have a final among the two divisional winners. Further, as the 
number of competitors tends to infinity, [MS06] show that the optimal highest quality objective is at least 
half of the optimal sum-of-qualities objective — we generalize this result and show that the factor of two 
ratio holds for any number of competitors. 

In this paper our goal is to optimize the quality of the best submission (unlike |MS01, Minll J which 
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consider total quality) with a total reward normalized to one (unlike [AS09] which optimizes the quality of 
the best submissions less the monetary reward). We study optimal crowdsourcing contests over all single- 
stage all -pay formats, unlike [MS06] which limits the format of one-stage contests but also studies two- 
stage contests. Our main results are to show that the wasted effort is not large and to characterize optimal 
crowdsourcing contests that can potentially divide the award between agents dynamically depending on the 
qualities of submissions. We also show that our model is consistent with that of [ MS0UIAS09I in that the 
optimal static allocation of the award is winner-take-alfj] 

The following other results relating to crowdsourcing contests are technically unrelated to ours. Di- 
Palantino and Vojnovic MDV091 study crowdsourcing websites as a matching market. They discuss equi- 
libria where contestants first choose which contest to participate in and then their level of effort. Yang et 
al. HYAA08H and DiPalantino and Vojnovic [DV09] empirically study bidder behavior from crowdsourcing 
website Taskcn and conclude that experienced contestants strategize better than others and their strategizes 
match the BNE predictions fairly well. 

There have been a number of studies of all-pay auctions in complete information settings (e.g., Baye et 
al. BBKdV9 61). but these works are also technically unrelated to ours. 



2 Preliminaries 



Auction Theory. Consider the standard auction-theoretic problem of selling a single item to n agents. 
Each agent i has a private value Vi for receiving the object and is risk-neutral with linear utility Ui = ViXi —pi 
for receiving the item with probability xi and making payment pi. An auction A solicits bids and determines 
the outcome which consists of an allocation x = (x\, . . . , x n ) and payments p = (pi, . . . ,p n ). 

Suppose that the agents' values are drawn i.i.d. from continuous distribution F (that is, having no point- 
masses) with distribution function F(z) = Pr[fj < z] and density function f(z). A Bay es-Nash equilibrium 
(BNE) in auction A is a profile of strategies for mapping values to bids in the auction that are a mutual best 
response, i.e., when the values are drawn from F and other agents follow their equilibrium strategies then 
each agent (weakly) prefers to also follow the prescribed strategy over taking any other action. 

Formally, on valuation profile v = (v±, . . . ,v n ), denote the composition of an auction and a strategy 
profile by allocation rule x(v) and payment rule p(v). When agent % is bidding in the auction, she knows 
her own value Vi and assumes that the other agent values are drawn from the distribution F. Denote her 
interim allocation and payment rules as Xi(vi) = E v [a?i(v) | vi\ andp,(i;,) = E v [pj(v) | Vj\, respectively. 
Bayes-Nash equilibrium requires that ViXi{vi) — pi(vi) > ViXi(z) — Pi{z) for all z and from this constraint 
is derived the standard characterization of BNE: 



Theorem 2.1 [Mye81 J Allocation and payment rules x(-) and p(-) are in BNE if and only if for all 
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1. Xi(vi) is monotone non-decreasing in Vi and 

2. pi(vi) = ViXiivi) - /„"' Xi(z)dz + pi(0) 
where usually Pi(0) = 0. 

A simple consequence of this characterization is the revenue equivalence principle which states that two 
mechanisms with the same equilibrium allocation have the same equilibrium revenue — in fact each agent's 
expected interim payment is the same. 

There are three standard formats for highest-bid-wins single-item auctions: first-price, second-price, 
and all-pay. In the first-price variant the highest bidder wins and pays her bid, in the second-price variant 

'Moldovanu and Sela in [MS06] also state that this should be true but do not provide a reference or a proof. 
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(a.k.a. the Vickrey auction) the highest bidder wins and pays the second highest bid, and in the all-pay 
variant the highest bidder wins and all bidders pay their bids. These auction formats all have BNE in which 
the agent with the highest valuation wins; Therefore, revenue equivalence implies that they have the same 
expected revenue (sum of payments) in equilibrium. 

The highest-bid-win auction formats do not always yield the highest expected revenue. To solve for op- 



timal auctions, Myerson [ Mye81[ defined virtual valuations for revenue as <f>{vi) = Vi — 1 and proved 



that the expected payment of an agent, ~E Vi [pi{vi)\ is equal to her expected virtual value [<p(vi)xi(vi)]. 
The distribution F is said to be regular if the virtual valuation function is monotone. For regular distribu- 
tions, maximizing virtual values point-wise is a monotone allocation rule, and therefore can be implemented 
in BNE. The corresponding revenue-optimal auction serves the agent with the highest positive virtual value. 
By symmetry, this agent is identically the agent with the highest value that meets a reserve price of </> _1 (0). 

Theorem 2.2 [Mye81] When the virtual valuation function </>(•) is monotone, the optimal auction format is 
highest-bid-wins with a reservation value of (j)~ 1 (Q), a.k.a., the monopoly price. 

It will be useful to be able to solve for the equilibrium strategies in all-pay auctions with reserves. 
Revenue equivalence makes this easy: the expected payment of an agent with value v.- t is the same in both 
the all-pay and the second-price auction formats. Of course in the all-pay format the agent always pays 
her bid; therefore, her bid b(vi) must be equal to her expected payment in the second-price auction. Let 
vu\ denote the jth largest value. Agent i's expected payment in the second-price auction when Vi > r, is 
exactly E v _. [max(%) ) '") I Vi = v (i)\ P r v_; [vi = v (i)] > so ner bid in the all-pay auction must be equal to 
this expectation. 

Lemma 2.3 In a highest-bid-wins all-pay auction with value reserve r an agent with value V( bids 

b(vi) = E v _ t [max(w( 2 ),r) | v { = -y (1) ] Pr Vi \v { = . 
if v i > r an d otherwise. 

The reserve specified above is in value-space. To implement such a reserve in an auction, one must 
translate it to a reserve in bid-space. For first- and second-price auctions this transformation is the identity 
function. For all-pay auctions, it can be calculated as follows. An agent with value equal to the reserve r 
in the second price auction pays the reserve if she wins, i.e., her expected payment is rPr v _ i [r = vn\\ = 
rF(r) n_1 . By revenue equivalence the same agent in the equivalent all-pay auction must bid this expected 
payment; as this bid is the minimum bid that should be accepted, it is the reserve. 

Lemma 2.4 The highest-bid-win all-pay auction with reserve bid rF(r) n ~ 1 implements the highest-value- 
wins allocation rule with a reserve value ofr. 

For irregular distributions, i.e., when </>(•) is non-monotone, the revenue-optimal auction is not reserve- 
price based. Instead it selects the highest virtual value subject to monotonicity of the allocation rule. This 
optimization can be simplified by a very general ironing technique. 



Theorem 2.5 [Mye81 \HR08\I There is an ironing procedure that converts any virtual valuation function 



(/>(•) to a ironed virtual valuation function 0(-J that is monotone and has the property that maximizing <j>{-) 
subject to monotonicity (of the allocation rule) is equivalent to maximizing </>(•) point-wise, with ties broken 
randomly. The BNE with this outcome is optimal. 
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Crowdsourcing. The following model for crowdsourcing contests and its connection to all-pay auctions 
was proposed in HDV091I . To outsource a task to the crowd a principal announces a monetary reward (nor- 
malized to 1). Each of n agents (the crowd) enters a submission. Agent i's skill is denoted by V{ and with 
effort, ei, she can produce a submission with quality pi = Ujej, i.e., her skill can be thought of as a rate 
of work and her effort the amount of work. Each agent's skill is her private information. If X{ fraction of 
the reward is awarded to agent i then her utility is m = X{ — e%. From her perspective Vi is a constant 
so maximizing utility is equivalent to maximizing V{Ui = ViXi — pi. Notice that this latter formulation of 
the agent's objective mirrors that from the single-item auction setting discussed previously; furthermore, as 
the agents exert effort up-front, crowdsourcing contests intrinsically have all-pay semantics. Because of this 
connection, it will be convenient to refer interchangeably to contests as auctions, skills as values, submission 
qualities as payments, and rewards as allocations. 

The objective for crowdsourcing contests A is to maximize the quality of the best submission. Because 
of the connection to all-pay auctions we refer to this objective as the maximum payment objective and denote 
its value for an auction A as MP [A] = E v [maxj Pi(y)]. This objective is quite different from the standard 
revenue maximization objective Rev[y4] = E v [^pi(v)]. 

One aim of this paper is to quantify the loss the principal incurs from running an all-pay auction versus a 
more conventional means of contracting. For instance, standard formats for procurement auctions are first- 
or second-price. Importantly, in first- and second-price auctions A all the payment comes from the highest 
bidder, therefore MP [A] = Rev [.A] and the principal is able to extract quality workmanship with no loss. In 
contrast, in all-pay auctions which are revenue equivalent to first- and second-price auctions the maximum 
payment is not equal to the total revenue and thus the efforts of non- winners constitute a loss in performance. 
We thus quantify the utilization ratio of an auction A as ^jjoj- 

We will see that the all-pay auction that optimizes maximum payment is not the same as the auction 
(all-pay or otherwise) that maximizes revenue. We define the approximation ratio of an all-pay auction to 
quantify its maximum payment relative to the revenue of the optimal (first-price or second-price) auction, 
i.e., A's approximation ratio is ^^j^p- The cost of crowdsourcing (over conventional procurement) is 

then the approximation ratio of the best all-pay auction, i.e., inf_4 ^p^p- 

Non-zero density Assumption. For the rest of this paper, the space of valuations V is assumed to be an 
interval and the density function /(•) is assumed to be non-zero everywhere in V. 



3 Utilization and approximation ratios 

As noted previously, the maximum payment of a second- or first-price auction is equal to its total payment 
or revenue. On the other hand, in all-pay auctions the payment made by non-winners leads to a loss in 
performance. In this section we quantify this loss for a special class of all-pay auctions, namely those that 
always reward the highest bidder subject to an anonymous reserve price. This further allows us to find a 
simple all-pay auction that approximates optimal procurement. 

In this section we consider highest-bidder-wins reserve-price auctions under either second-price or all- 
pay semantics. It is easy to see that under all-pay semantics these auctions induce symmetric continuous 
increasing bid functions at BNE and therefore their allocation function is identical to a second-price auction 
with an appropriate reserve price. 

Theorem 3.1 Let A be any highest-bidder-wins reserve-price all-pay auction. Then Rev [A] < 2MP[A\. 
That is, its utilization ratio is bounded by 2. 
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Proof: Let x denote the allocation function of the auction and suppose that the bid function that it induces 
in BNE is given by b(v). We can write the expected revenue of the auction as the sum of the contribution 
from the winning agent (i.e. the agent with the maximum payment), and the contribution from other agents. 
Call the first term A and the second B. 

Rex[A) = Y, f Hv)Vr V -< [v = v {1) ] f(v) dv + J^ f Kv)(l - Pr v _, [t; = U(1) ] )f(v) dv 

Jv ■ Jv 



I 



B 



Note that A is precisely MP [.A]. We will now show that A > B, or A — B > 0. By the revenue equivalence 
principle, b(v) is equal to the expected payment that an agent with value v makes in a second-price auction 



with the same allocation rule (Lemma 2.3 1. Let g(v) denote the expected payment in the second-price 
auction with reserve, given that v is the highest value. Then we get that b(v) = g(v)Pr v _. [f = «m] . We 
note that Pr v _. \y = tin) = F(v) n is a strictly increasing function since f(v) ^ for all v € V. Now 
we can write A — B as 

A-B = J2 f &M(2Pr v _, [v = v {1) ) - l)f(y) dv 
i Jv 

= Y ! g{v)F{v) n - l {2F{v) n - 1 -l)f(v)dv 
i Jv 

= n- [ g(F- 1 (t))t n - 1 (2t n - 1 -l)dt 

where, in the third equality, we substituted t for F(v). 

Next we note that ignoring the g term, the integral is non-negative: 



C t n - 1 (2t n - 1 -l)dt = — ->0 

Jo 2n-\ n 



Let us consider the effect of the g term. The function t n 1 (2t n 1 — 1) vanishes for two values of t namely 

i i 
and (1/2) Between these two values the function is negative, and for t > (1/2) « =T , the function 

is positive. So when the function is multiplied by g(F^ 1 (t)), a non-decreasing function of t, the negative 

portion of the integral is magnified to a smaller extent than the positive portion, implying that the integral 

stays positive. This completes the proof. ■ 



Tightness of Theorem |3.1| We now exhibit an example where the utilization ratio of 2 is tight. Consider a 
setting with n agents, with each agent's value distributed independently according to the U[0, 1] distribution. 
Consider the second-price auction with no reserve price. The expected revenue of this auction can be 
computed to be The corresponding all-pay auction induces a bid function b(v) = n ^v n . The expected 
revenue of the all-pay auction is the same as that of the second-price auction, namely, ^j-, which approaches 
1 as n increases. On the other hand, the expected maximum payment can be computed to be which 
approaches 1/2 as n increases. In Section [4] we will revisit this example and show that even the optimal 
all-pay auction (which is slightly better) only achieves an expected maximum payment approaching 1/2 for 
this setting. 
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Utilization ratio for other all-pay auctions. We note that the bound on utilization ratio does not hold for 
arbitrary symmetric all-pay auctions. For example, the all-pay auction corresponding to a revenue-optimal 
auction that requires ironing over large intervals of values induces a bidding function that is constant over 
those intervals. This results in many agents being tied for the reward, all making the same (low) payments 
but only one contributing to the maximum payment. 



Approximation ratio. Recall that the approximation ratio of an all-pay auction A is ^M^ptp » wnere 
OPT is the revenue optimal auction. We now use the bound on utilization ratio to prove that all-pay auctions 
achieve good approximation ratios. In particular, we note that for regular distributions highest-bidder-wins 
reserve-price auctions are revenue-optimal (Theorem |2.2|). For irregular distributions, [CHMS10] show that 



highest-bidder-wins auctions with an anonymous reserve price are within a factor of 2 of optimaj^] The 



following corollaries then follow from Theorem 3.1 upon applying the revenue equivalence principle 



Corollary 3.2 When agents' value distributions are regular, there exists an a such that the highest-bid-wins 
all-pay auction with reserve bid a achieves an approximation ratio at most 2. 



Corollary 3.3 For all i.i.d. value distributions, there exists an a such that the highest-bid-wins all-pay 
auction with reserve bid a achieves an approximation ratio at most 4. 

These corollaries imply that the cost of crowdsourcing is always small — no more than 4. The above 
example with uniform distributions shows that the approximation factor in Corollary |3.2| is tight. An exten- 
sion of the same example in Section [4] shows that the worst-case cost of crowdsourcing can be no smaller 
than 2. 



4 Optimal crowdsourcing contests 

In this section we characterize optimal crowdsourcing contests, first over a limited class of so-called "static" 
contests, and then over all contests. 



Static Contests. Consider the class of contests that predetermine the division of the reward into a±, . . . a n , 
with Y^i Q-i = 1- Agents are ordered by their submission qualities and awarded the corresponding fraction of 
reward, i.e., the ith best submission gets an Oj fraction of the reward. Note that the Topcoder.com example 
mentioned in the introduction, where the best submission receives 2/3rds and the second-best submission 
receives l/3rd of the total reward, falls under this class of contests. For this class, the following theorem 
shows that the optimal contest allocates the entire reward to the best submission; we defer the proof to 
Appendix [A] 

Theorem 4.1 When the bidders' valuations are i.i.d., the optimal static all-pay auction is a highest-bid-wins 
auction. 



Symmetric Contests. For the rest of this section, we focus on the class of arbitrary symmetric contests. 
A symmetric auction is one where a permutation of bids results in the same permutation of the allocation 
and payments. Since agents' private values are identically distributed, any such symmetric allocation rule 



2 While highest-bidder-wins auctions with a non-anonymous reserve give a better approximation to the optimal revenue, they 



induce an asymmetric all-pay auction and Theorem 3.1 does not apply. 
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induces a symmetric equilibrium in which all agents use an identical bidding function. This in turn implies 
that the allocation as a function of agents' values is also symmetric across agents. 

We first present a characterization of the expected maximum payment of any symmetric all-pay auction 
in terms of an appropriately defined virtual value function. This characterization immediately implies that 
the optimal mechanism is a virtual value maximizer. 

Definition 1 For a given distribution F with density function f and an integer n, we define the virtual value 
for maximum payment, ip n (z) as 

i _ F(z) n 

Lemma 4.2 Consider a setting with n agents and values distributed i.i.d. according to distribution F. Let A 
be a symmetric all-pay auction implementing the allocation function x. Then ~MP[A] = Xi(v)ip n (vi)]. 

Proof: Suppose that the allocation function x induces a symmetric bid function £>(•) on the agents. Recall 
that by the revenue equivalence principle, b(v) is equal to the expected payment that an agent with value 



v makes under x(-). From Theorem 2.1 we get the following expression for b(v) where x\ is the expected 



allocation to agent i in expectation over v_j. 

b{vi) = ViXi(vi) - / Xi(z) dz 
Jz=0 

Because the equilibrium is symmetric, one of the agents with the highest bid is the agent with the highest 
valud^J i.e., with V{ = v^y We attribute the maximum payment received by the mechanism to this agent. 
We can now use the above formulation of the bid function to calculate the expected contribution of agent i 
to the maximum payment objective. 

MPi[A}= ! b(vi)Pr v _ t [v i = v {1) ]f(v l )dv i 

J Vi 

rvi 

ViXi(vi) - / Xi{z)dz F(vi) n ~ 1 fi(v i )dv i 

Jz=0 

In order to simplify the second term in the integral we interchange the order of integration over z and Vi, 
integrate over v^, and then rename z as i>j. We get: 

MP,[„4]= / v l x t (v t )F(v i ) n - 1 f i (v l )dv l - [ Xi {vi) f 1 ~ dv{ 
Jvi Jv t \ n J 

n J\ v i) J 

Xi{vi)ip n {vi)fi{vi) dvi 
= Ev[xi(v)ip n (vi)] 

Summing over i implies the lemma. ■ 
3 Note that the bid function need only be weakly increasing, so there may be ties for the highest bid. 
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Optimal allocation rules and regularity. The characterization of Lemma |4~2| immediately implies that in 
order to maximize the expected maximum payment, we should maximize the virtual surplus of the mech- 
anism for maximum payment. In other words, we should allocate the entire reward to the agent that has 
the maximum virtual value tp n (vi) (subject to this value being non-negative). However, this results in a 
monotone allocation function only if the virtual value function is monotone non-decreasing. To this end, we 
define regularity for maximum payment as follows. 

Definition 2 A distribution F is said to be n-regular with respect to maximum payment if ip n (-) is a mono- 
tone non-decreasing function. The distribution is said to be regular w.r.t. maximum payment if ip n (-) is 
monotone non-decreasing for all positive integers n. 

For distributions that are regular w.r.t. maximum payment, allocating to the agent with the highest non- 
negative virtual value is monotone and therefore can be implemented in BNE. Since agents have i.i.d. values, 
this outcome corresponds to allocating to the agent with the highest value, who is in turn the agent with the 
highest bid. Therefore, the optimal mechanism is a highest-bid-wins reserve-price mechanism. The reserve 



value for the mechanism is given by ^~ 1 (0) and the reserve bid can be computed by applying Lemma 2.4 
to this value. We note that generally the reserve price is a function of n and decreases with n, even for 
distributions that are regular for all n. 

Theorem 4.3 Let F be a distribution that is n-regular w.r.t. maximum payment. Then the optimal all-pay 
auction for n agents with values distributed independently according to F is a highest-bid-wins auction with 
a reserve price. 



Two examples. We now revisit the example with n agents and values distributed according to U[0, 1] that 
was discussed in Section[3j The following expression defines the virtual value for maximum payment in this 
case: 

i/, n (z) = z n (l + l/n) - l/n for z G [0, 1] 

This is an increasing function for all n. Therefore, the U[0, 1] distribution is regular. The optimal reserve 
value is given by ip~ 1 (0) = (n + l) _1//ra , and the optimal reserve bid is l/(n + 1). Therefore, the optimal 
all-pay auction serves the highest bidder subject to her bid being at least l/(n + 1) . The expected maximum 
payment of this auction can be calculated to be 2 {n+i) wmc h approaches 1/2 as n increases. 

Next consider a setting with two agents and values distributed i.i.d. according to the exponential dis- 
tribution. That is, F(v) = 1 — e~ v for v > 0. We can calculate the virtual value function as ip2(z) = 
(z — 1) + e~ 2 (l/2 — z). This function is negative below 1.21 and positive thereafter. Furthermore, it is 
non-decreasing above 0.24, particularly throughout the range where it is non-negative. So although the ex- 
ponential distribution is not regular w.r.t. maximum payment, the optimal all-pay auction still turns out to 
be a highest-bid-wins auction with a reserve price of 1.21 and a corresponding reserve bid of 0.85. 

An interesting point to note about the above example is that distributions that are regular with respect to 
the usual notion of virtual value for revenue, are not necessarily regular with respect to maximum payment 
even for n = 2. However, for a large subset of such distributions, namely those that satisfy the monotone 
hazard rate condition (Definition [3] below), the optimal all-pay auction continues to have the simple form 



given in Theorem 4.3 



Regularity and MHR. A common assumption in mechanism design literature is that value distributions 
satisfy the monotone hazard rate (MHR) condition defined below. Many common distributions such as the 
uniform, Gaussian, and exponential distributions satisfy this property. Distributions that satisfy MHR are 
regular and therefore do not require ironing in the context of revenue maximization. As our example above 
shows, MHR distributions are not necessarily regular with respect to maximum payment. 
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Definition 3 The hazard rate of a distribution F with density function f is defined as h(x) = prM^y - A 
distribution is said to have a monotone hazard rate (MHR) if the hazard rate function is monotone non- 
decreasing. 

Lemma 4.4 Let F be a distribution satisfying the MHR condition. Then for any n and any interval of values 
over which ip n is non-negative, ip n is monotone non-decreasing. 

Proof: We can rewrite the virtual value function in terms of the hazard rate h(z) of the distribution as 
follows. 

1 n— 1 

i, n {z) = zF{zT^-— ^F(zy 

K ' 3=0 



F(z 



,n-l 



nh( 



1 1 



The function h(z) is a non-negative non-decreasing function. Therefore, (— l/nh(z)) is a negative non- 
decreasing function. On the other hand, Sj=o ^X- 2 ) - " 7 * s a decreasing function of z. The product of a 
negative non-decreasing function and a decreasing function is a non-decreasing function. Therefore, the 
term within brackets is a non-decreasing function of z. The term outside brackets, F{z) n ~ l , is also an 
always positive increasing function. Therefore, the product of the two terms is an increasing function over 
any interval where it is positive. ■ 

We obtain the following corollary. 

Corollary 4.5 Let F be a distribution that satisfies MHR. Then the optimal all-pay auction for values dis- 
tributed independently according to F is a highest-bid-wins auction with a reserve price. 

Irregular distributions and ironing. For distributions that are not regular according to the definition 
above, we can apply an ironing procedure from Theorem|2.5|to ip n to obtain an ironed virtual value function 



ip n . This function is monotone non-decreasing and by Theorem 2.5 the BNE that optimizes it point-wise 
optimizes the maximum payment objective. 

The optimal mechanism in this case allocates the entire reward to the agent with the maximum ironed 
virtual value, in the case of ties distributing the reward equally among the tied agent^] Since the ironed 
virtual value function is a weakly increasing function, the induced bid function is constant in the intervals 
where the ironed virtual value is constant, and discontinuous at the ends of those intervals. In effect, this 
creates intervals of bids that are suboptimal to make at any value; call these bid intervals "forbidden". In 
order to implement the mechanism as an all-pay auction, we identify the forbidden bid intervals; then we 
round every bid in a forbidden bid interval down to the closest "allowed" bid, and distribute the reward 
equally among the highest bidders (subject to an appropriate reserve price defined by (?/> n ) -1 (0)). We 
therefore get the following theorem: 

Theorem 4.6 For any setting with i.i.d. values, the optimal all-pay auction is defined by a reserve price 
and a subset of bids called forbidden bid intervals, that has the following format: the auction solicits bids 
and rounds them down to the nearest non-forbidden bids; it then distributes the reward equally among the 
highest bidders subject to the bids being above the reserve price. 



4 An equivalent way of resolving ties in the maximum ironed virtual value is to allocate the reward to a random tied agent. 
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Figure 1 : The Ironing Procedure 



An example of ironing. We now present a simple example of a distr ibution that is irregular w.r.t. maximum 
payment, and derive its ironed virtual value and as well as forbidden bid intervals. There are two agents, 
each with a value drawn independently from U[l, 2] with probability 3/4 and from U[2, 3] with probability 
1/4. Figure [Tjbelow shows the virtual value function ^2 and its integral with respect to q = F(v) using thick 
grey lines; their ironed counterparts are shown in thin red lines. The integral of the virtual value function 
as a function of q is given by the expression ^F _1 (g)(l — q 2 ). We iron this function by taking its convex 
envelope; ip 2 * s tnen tne derivative with respect to q of that convex envelope. 

The ironed virtual value is constant in the interval [1.918,2.167]. The probability of allocation (not 
plotted), and therefore the bid function, are also constant over this interval. The corresponding bid func- 
tion is plotted with a thin black line below; there are two forbidden bid intervals, namely [1.10, 1.199) and 
(1.199, 1.31], with the intermediate value of 1.199 being allowed. The two forbidden bid intervals corre- 
spond to the two discontinuities in the probability of allocation at the end points of the ironed interval. 

Irregularity as a function of n. An interesting point to note is that irregularity increases with n. Specifi- 
cally, the intervals of values that require ironing under ip n increase with nj^This does not necessarily imply 
that as n increases a larger and larger number of agents are tied for the reward, for two reasons: (1) reserve 
value (not the reserve bid) could increase with n, and (2), due to the form of the virtual value function, 
ironing is typically necessary at low values rather than at high values. 

Asymmetric contests. We remark that even for symmetric instances (i.e. i.i.d. values) asymmetric all- 
pay auctions can be more powerful than symmetric all-pay auctions. We now present an example that 
exhibits this. Consider two contestants with values drawn i.i.d. from [0, 1] according to the distribution 
F(x) = x 1 - 5 . The optimal symmetric auction studied in this paper sets a reserve value of (0.25) 1 / 3 = 0.63 
(which translates to a reserve bid of (0.25) 5 / 6 = 0.315) and serves the highest bidder who exceeds this 
reserve bid. This gives an expected maximum payment of 0.396. 

5 This happens because the intervals requiring ironing are precisely those where the integral of the virtual value function is non- 
concave; Increasing n amounts to multiplying the integral with a convex function resulting in non-concave intervals continuing to 
stay non-concave. 
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We now define a better auction that favors contestant 1 over contestant 2. The rules of the contest in value 
space are as follows. When contestant l's value is more than 0.75 we serve him irrespective of contestant 
2's value, otherwise we serve the contestant with the higher value subject to a reserve value of 0.63. This 
allocation rule creates a discontinuous increase in the expected allocation probability of player 1 at 0.75, 
and hence a discontinuity in his bid function at 0.75. In bid space, this corresponds to the following contest: 

1. We set a reserve bid of 0.315 as before. 

2. All bids of contestant 1 in the range [0.418, 0.681) get rounded down to 0.418. 

3. When contestant 1 bids at least 0.681 he wins irrespective of 2's bid. 

4. Otherwise, the highest bidder wins with ties broken in favor of contestant 2. 

By guaranteeing victory for contestant 1 beyond a certain bid, the above auction encourages contestant 
1 to bid higher, thus boosting maximum payment. Since the objective is maximum payment, this type of 
bias is useful: the asymmetric auction obtains a smaller revenue but a larger expected maximum payment of 
0.397. We remark that in a real-world setting with a priori identical agents, favoring one agent over another 
may be socially unacceptable. 



5 Prior-independent approximation 

As we show above, optimal crowdsourcing contests depend on knowing the agents' value distribution. To 
what extent is it important to know the distribution? In particular, under what conditions does the simple 
highest-bidder-wins contest without any reserve bid approximate the optimal one? We now show that for 
distributions that are regular w.r.t. revenue the simple highest-bidder-wins contest obtains an approximation 
ratio of 2n/(n — 1), thus limiting the power of distributional knowledge. 

For the standard goal of maximizing expected revenue, Bulow and Klemperer showed that for i.i.d. value 
distributions that are regular w.r.t. revenue, it is better to run a Vickrey auction with no reserve price onn+1 
agents than to run an optimal auction on only n agents. That is, the ability to recruit an extra agent in the 
auction is more profitable to the auctioneer than knowing the distribution. 

We first note that Bulow and Klemperer's result implies that for distributions that are regular w.r.t. 
revenue, the highest- value-wins auction with no reserve price on n agents is within a factor of (1 — 1/n) 



of the optimal mechanism in terms of revenue. This combined with Theorem 3.1 gives us the following 
theorem. 



Theorem 5.1 For i.i.d. distributions that are regular w.r.t. revenue, the highest-bid-wins all-pay auction 
without a reserve bid obtains an approximation ratio of In I (n — 1). 

We remark that for the highest-value-wins auction without reserve prices, the revenue converges to the 
optimal as more and more agents are added. However for all-pay auctions adding more and more agents 
does not improve the approximation ratio beyond 2. 
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A Proof of Theorem |4J] 



Proof of Theorem 4.1 We begin by noting that the class of static auctions is symmetric, i.e., a permutation 
of bids results in the same permutation of the allocation and payments. Since agents' private values are 
identically distributed, any such symmetric allocation rule induces a symmetric equilibrium in which all 
agents use an identical bidding function. This in turn implies that the allocation as a function of agents' 
values is also symmetric across agents. 

Let the agent values be distributed independently according to distribution function F, with density 
function /. Consider the static allocation rule A = (ai, . . . , a&, 0, . . . , 0), i.e, the agent with the 2-th highest 
bid gets eij fraction of the reward if % < k, an otherwise. We have Yli=i a i = 1- We focus on the symmetric 
bid-function &(•) induced by this allocation rule. 

In a truthful auction with allocation rule A, the expected payment made by the r-th highest bidder is 
Pr( z ) = Ylj=l+i v jr(z)(aj-i — ctj), where Vj r (z) is the expectation of the j'-th highest bid (=value) given 
the r-th highest bid is z. 

Let g(j, n, z) denote the expectation of the j-th highest draw among n draws from F, given that the 
maximum draw is at most z. Then we have Vj r (z) = g(j — r,n — r, z). 
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The contribution of bidder i to the maximum payment objective is 

MPi[A] = [ b(vi)Pr v _. [vi = «(!)] f(vi) dvi 

J Vi 

Since agents values are drawn i.i.d. from F, we have MP[y4] = nMPj[»4]. 

Because the bid functions are symmetric, by the revenue equivalence principle, b(z) equals the expected 
payment made by an agent with value z in a truthful auction with the same allocation rule. So, 



K z ) = 5Z Pl " v -* \- Z = V (r)] m M z ) 

'n — \ 



r=l 

k 

£ 

r=l 



r- 1 



(l-F(z)) r - 1 F(z) n - r 



k+l-r 



^2 g(j,n-r,z)(a j+r -i- a j+r ) 



We prove the theorem by showing that dM J^j^ is negative. When we change a& we assume that all the 
mass is transferred to (or drawn from) a\. This will prove that the optimal allocation rule is to put all the 
mass on a\, i.e., a\ = 1. 

Using the formula for b(z), it is easy to observe that for r = 2 to r = k — 1, terms corresponding to that 
specific r in dM J* ^ will be an integral with an integrand of 



da k 

n — 1 
r - 1 



(l-F(z)) r - L F(z 



r—l r-i/ „\2n— r— 1 



{— g{k — r,n — r, z) + g(k — r + 1, n — r, z)} 



This integrand is negative because g is a decreasing function in its first argument. 

The term corresponding to r = 1 in dM J^ ^ will be an integral with an integrand of 



F(z) 2n ~ z ■ {-g(l, n -l,z)-g(k-l,n- 1, z) + g(k, n-1, z)} 

Note that the above integrand is negative even if g(l, n — 1, z) term were not there. 

The term corresponding to r = k in dM Jjj^ will be an integral with a positive integrand of 



n — 1 
ife-1 



fc— 1 „\2n— k— 1 



{^(l, n - /c,z)} 



Our proof is going to upper bound dM J^jf^ by ignoring certain negative terms in it, and show that even 
the upper bound is negative. In particular, we only consider terms corresponding to r = k — 1, r = k and 
one term of r = 1, namely F(z) 2n ~ 2 ■ {—g(l,n — 1, z)}. Let this upper bound be denoted by Q. 



dMPi[A] 

da k 



<Q = ~l F(z) 2n ~ 2 g(l,n - 1, z) dF(z) 

(1 - F(z)) k - 2 F(z) 2n - k g(l, n-k + l,z) dF{z) 
(1 - F(z)) k ~ 2 F(z) 2n - k g(2, n-k + l,z) dF{z) 
(1 - F(z))^ 1 F(z) 2n ~ fc ~ 1 5 (l, n-k,z) dF{z) 



+ 
+ 



n — 1 
fc-2 
n — 1 
fc-2 
n — 1 
fc- 1 
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We derive the expressions for g(l, n, z) and g(2, n, z) below. 

9(l,n,z) = nJ Q y W) [ W) ) dy 
IoF(t) n dt 



F(z) 

g(2,n,z) =n(n- 1) J Vj^yj \ 1 - — > ' — > 



n-2 



= Z — 



-(n-1) 



F{z)J \F(z)J 

foHtTdt 



dy 



We susbtitute the expression for g into Q. 

Q = - [ F(z) n - 2 zF(z) n - f F(t) n 

J z L J z 

+ (i:0/ (1 - F(2,)l " lF( 

j{\ - F(z)) fe - 2 F(z) n - 1 (jT F{t) n ~ k+l dt) dF{ 
(n-k) [ (1 — F(z)) h ~ 2 F(z) n ~ 1 



dt dF(z) 
) 2n - k - l zdF{z) 



+ 
+ 



n — 1 
k-2 
n — 1 
k-2 

n — 
k 

n-1 
k-l 



jT F(t) n - k+1 dt) dF{z) 
~ *) (n - k + 1) (1 - F(z)) fc - 2 F(z) n ( jT dt) dF(*) 



fc— 1 p/.\n-l 



F(t) n ~ fe ) dF{z 



We now factor the term (1 - F(z)) k 1 as (1 - F(z)) k 2 • (1 - F(z)) and then group terms. We get 



k-2 



Q = - I F(z) n - 2 \zF(z) n - I F(t) 

J z _ J z 



dt 



dF(z) 



n - 1 
k-l 



(1- F{z)) k - 2 F{z) 2n - k zdF{z) 
+ (fc I 2) (n " fc + X) / (1 " i? (^))^ 2i? (^) n_1 F(t) n - k+1 dt) dF(z) 

~ C - 2) [ (n " k + 1} " ~T~~T~] / (1 - F ^)f- 2 F{zT (jT W fe *) dF(* 
~ (fc - 1) / (1 ~ F (*)) fe_2F ( z ) n_1 (f* F w n ~ kdt ) dF ^ 
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We have to prove that Q < 0. This is equivalent to proving that 

F{z) n - 2 zF{z) n - jT F{t) n dt dF{z) 

+ (fell) /t 1 - n*))*- 2 w- 1 

(1 - F(z)) fc " 2 F(z) n - 1 



- 1 - r Fit) 

Jo 



n-k+l 



dt 



dF(z) 



n — 1 
it- 1 



zF(z 



n—k 



F(t) n ~ k dt 



dF(z) 



> 



n — 
k- 
n — 1 
k 



^ (fe - 2) jf (1 - F(z)) fc - 2 F(z)™- 1 ^J* F(t) n ~ k+1 dtj dF(z) 
j) (k - 2) jf (1 - F(z)) k ~ 2 F(zr QT eft) dF(z) 



The RHS can be seen to be negative. Thus it is enough to prove that the LHS is positive. Rewriting the 
terms in the square bracket via integration by parts, 

njF(z) n ~ 2 (J* tFit)"- 1 dF(t) \ dF{z) 

+ (™ ~ (n - k + 1) J(l - F{z)) k - 2 F{z) n ~ l ^ jf tF{t) n - k dF(tfj dF(z) 
j{\-F{z)f- 2 F{z) n - 1 ^J* tF(t) n - k - 1 dF(t)j dF(z) 



[n — k) 



Jfe-1 

Changing the order of integration, we have the LHS as, 

'Fit) 



roc 

/ tF(t) n - k - l f{t) 
Jt=o 



_ ^ (n - k + 1) I J 1 (1 - F{z)) k - 2 F{z) n - 1 dF(z 



n - 1 

k 



F(t) 



n — k 
n — k + 1 



> dt 



+n 



F{z) n - 2 dF{z) I F(tY 



F(t) 



Applying integration by parts again, (this time taking t as one term and the rest as the differential part) we 
get the LHS as, 



/ 



/ / u n - k - 1 
Jt=0 JF(t) 



n — 1 
k — 1 



(n-k+l) 



(/>" 



F(z)) k - 2 F(z) n - 1 dF(z) 



u — 



n — k 
n — k + 1 



+n ( / F(z) n - 2 dF{z) ) u 



du 



dt 



Rewrite the above integral as f™ Q H n (F(t)) dt where 
H n (x) = £ u n ~ k - 1 {(l~%n-k + l) - v) k - 2 v n ~ l dv^j 



n — k 



n — k + 1 

If we prove that H n (x) is always non-negative for x € [0, 1] we are done. We have 



+ n{ v n 2 dv | u k \ du 



-H' n (x) = x n - k ~ x | _ ^ (n - k + 1) *(1 - u^-V" 1 dt; 



x — 



n—k 
n — k + 1 



+ n 



J X 



dv | x fc 
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Observe that —H' n (x) is negative for small values of x and positive for large values of x and never 
becomes negative after it has become positive. Thus, H n {x) is first increasing and then decreasing. We 
know that H n (l) = 0. If we prove that H n (0) > 0, we would have proven that H n (x) is always non- 
negative. 



fln(O) 



+ n 



n — 1 
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The integral cos m (0)sm n (#) d9 = Accordingly, we have 
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